Skip to content

chore: end-to-end guardrails logging of traces (llm_call--> guardrails execution) in Sentry and other chores - #152

Merged
Prajna1999 merged 13 commits into
logging/traceabilityfrom
logging/sentry-otel
Sep 11, 2026
Merged

Prajna1999 merged 13 commits into
logging/traceabilityfrom
logging/sentry-otel

Conversation

@Prajna1999

@Prajna1999 Prajna1999 commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Summary

Target issue is #150 #153 #154

  • Sentry / Otel wiring up for guardrails execution hooked up with kaapi-backend project
  • Remove guardrails hub online inference dependency (using validators as packages now)
  • Fix CI to make sure guardrails dont require online validations.
  • Disable llamaguard_7b validator for now as online inference has been sunset by guardrails hub
Screenshot 2026-09-10 at 1 47 34 PM

Checklist

Before submitting a pull request, please ensure that you mark these task.

  • Ran fastapi run --reload app/main.py or docker compose up in the repository root and test.
  • If you've fixed a bug or added code that is tested and has test cases.

Notes

Please add here if any other information is required for the reviewer.

@coderabbitai

coderabbitai Bot commented Sep 2, 2026

Copy link
Copy Markdown

Important

  • 🔍 Trigger review

This repository does not receive automatic reviews because it has fewer than 10 stars.

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Advanced

Run ID: 4a3369e2-ee7a-482a-be44-f66e99877683


Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@Prajna1999
Prajna1999 requested a review from Ayush8923 September 3, 2026 04:18
@Prajna1999 Prajna1999 self-assigned this Sep 3, 2026
@github-project-automation github-project-automation Bot moved this to To Do in Kaapi-dev Sep 3, 2026
@Prajna1999 Prajna1999 moved this from To Do to In Review in Kaapi-dev Sep 3, 2026
@Prajna1999 Prajna1999 removed this from Kaapi-dev Sep 3, 2026
@Prajna1999
Prajna1999 requested review from vprashrex and removed request for Ayush8923 September 3, 2026 04:23
@Prajna1999 Prajna1999 linked an issue Sep 6, 2026 that may be closed by this pull request
@Prajna1999 Prajna1999 changed the title Logging/sentry otel chore: end-to-end guardrails logging of traces (llm_call--> guardrails execution) in Sentry and other chores Sep 6, 2026
@Prajna1999

Copy link
Copy Markdown
Contributor Author

Remove spans for queries altogether, they expose user query and llm_response @Prajna1999

…M spans

Log streaming and service identity will be supplied by the ai-platform
(via baggage) rather than configured here, so remove
CLOUDWATCH_LOG_GROUP/STREAM, AWS_REGION, OTEL_SERVICE_NAME, and the
watchtower-based CloudWatch handler.

Also stop wrapping individual LLM calls in an OTel span: any span
covering a single completion ends up carrying the user query and/or
LLM response, which should never be exposed in traces.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
@Prajna1999
Prajna1999 merged commit 92a47e1 into main Sep 11, 2026
2 checks passed
@Prajna1999
Prajna1999 deleted the logging/sentry-otel branch September 11, 2026 11:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

2 participants